Pandas Profiling Report

Dataset statistics

Number of variables	20
Number of observations	21597
Missing cells	0
Missing cells (%)	0.0%
Duplicate rows	3
Duplicate rows (%)	< 0.1%
Total size in memory	3.3 MiB
Average record size in memory	160.0 B

Variable types

Numeric	17
Categorical	3

Alerts

Dataset has 3 (< 0.1%) duplicate rows	Duplicates
`price` is highly correlated with `bathrooms` and 5 other fields	High correlation
`bedrooms` is highly correlated with `sqft_living`	High correlation
`bathrooms` is highly correlated with `price` and 6 other fields	High correlation
`sqft_living` is highly correlated with `price` and 5 other fields	High correlation
`sqft_lot` is highly correlated with `sqft_lot15`	High correlation
`floors` is highly correlated with `yr_built`	High correlation
`grade` is highly correlated with `price` and 5 other fields	High correlation
`sqft_above` is highly correlated with `price` and 5 other fields	High correlation
`yr_built` is highly correlated with `bathrooms` and 5 other fields	High correlation
`zipcode` is highly correlated with `yr_built` and 2 other fields	High correlation
`long` is highly correlated with `yr_built` and 1 other fields	High correlation
`sqft_living15` is highly correlated with `price` and 4 other fields	High correlation
`sqft_lot15` is highly correlated with `sqft_lot`	High correlation
`waterfront` is highly correlated with `view`	High correlation
`view` is highly correlated with `waterfront`	High correlation
`condition` is highly correlated with `yr_built`	High correlation
`sqft_basement` is highly correlated with `price` and 3 other fields	High correlation
`lat` is highly correlated with `zipcode`	High correlation
`sqft_basement` has 13110 (60.7%) zeros	Zeros
`yr_renovated` has 20683 (95.8%) zeros	Zeros

Reproduction

Analysis started	2022-11-16 11:51:38.678181
Analysis finished	2022-11-16 11:53:03.349888
Duration	1 minute and 24.67 seconds
Software version	pandas-profiling v3.4.0
Download configuration	config.json

id
Real number (ℝ_≥0)

Distinct	21420
Distinct (%)	99.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	4580474288

Minimum	1000102
Maximum	9900000190
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	168.9 KiB

Quantile statistics

Minimum	1000102
5-th percentile	512740390
Q1	2123049175
median	3904930410
Q3	7308900490
95-th percentile	9297300412
Maximum	9900000190
Range	9899000088
Interquartile range (IQR)	5185851315

Descriptive statistics

Standard deviation	2876735716
Coefficient of variation (CV)	0.6280431971
Kurtosis	-1.260749894
Mean	4580474288
Median Absolute Deviation (MAD)	2402530270
Skewness	0.243225522
Sum	9.892450319 × 10¹³
Variance	8.275608378 × 10¹⁸
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
795000620	3	< 0.1%
6308000010	2	< 0.1%
3528000040	2	< 0.1%
3303000130	2	< 0.1%
8651510380	2	< 0.1%
6669020290	2	< 0.1%
726049190	2	< 0.1%
7961500010	2	< 0.1%
2019200220	2	< 0.1%
4435000705	2	< 0.1%
Other values (21410)	21576	99.9%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1000102	2	< 0.1%
1200019	1	< 0.1%
1200021	1	< 0.1%
2800031	1	< 0.1%
3600057	1	< 0.1%
3600072	1	< 0.1%
3800008	1	< 0.1%
5200087	1	< 0.1%
6200017	1	< 0.1%
7200080	1	< 0.1%

Value	Count	Frequency (%)
9900000190	1	< 0.1%
9895000040	1	< 0.1%
9842300540	1	< 0.1%
9842300485	1	< 0.1%
9842300095	1	< 0.1%
9842300036	1	< 0.1%
9839301165	1	< 0.1%
9839301060	1	< 0.1%
9839301055	1	< 0.1%
9839300875	1	< 0.1%

price
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	3622
Distinct (%)	16.8%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	540296.5735

Minimum	78000
Maximum	7700000
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	168.9 KiB

Quantile statistics

Minimum	78000
5-th percentile	210000
Q1	322000
median	450000
Q3	645000
95-th percentile	1160000
Maximum	7700000
Range	7622000
Interquartile range (IQR)	323000

Descriptive statistics

Standard deviation	367368.1401
Coefficient of variation (CV)	0.6799379417
Kurtosis	34.54135858
Mean	540296.5735
Median Absolute Deviation (MAD)	150000
Skewness	4.023364652
Sum	1.16687851 × 10¹⁰
Variance	1.349593504 × 10¹¹
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
350000	172	0.8%
450000	172	0.8%
550000	159	0.7%
500000	152	0.7%
425000	150	0.7%
325000	148	0.7%
400000	145	0.7%
375000	138	0.6%
300000	133	0.6%
525000	131	0.6%
Other values (3612)	20097	93.1%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
78000	1	< 0.1%
80000	1	< 0.1%
81000	1	< 0.1%
82000	1	< 0.1%
82500	1	< 0.1%
83000	1	< 0.1%
84000	1	< 0.1%
85000	2	< 0.1%
86500	1	< 0.1%
89000	1	< 0.1%

Value	Count	Frequency (%)
7700000	1	< 0.1%
7060000	1	< 0.1%
6890000	1	< 0.1%
5570000	1	< 0.1%
5350000	1	< 0.1%
5300000	1	< 0.1%
5110000	1	< 0.1%
4670000	1	< 0.1%
4500000	1	< 0.1%
4490000	1	< 0.1%

bedrooms
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	12
Distinct (%)	0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	3.373199981

Minimum	1
Maximum	33
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	168.9 KiB

Quantile statistics

Minimum	1
5-th percentile	2
Q1	3
median	3
Q3	4
95-th percentile	5
Maximum	33
Range	32
Interquartile range (IQR)	1

Descriptive statistics

Standard deviation	0.9262988945
Coefficient of variation (CV)	0.2746053894
Kurtosis	49.82183475
Mean	3.373199981
Median Absolute Deviation (MAD)	1
Skewness	2.023641235
Sum	72851
Variance	0.858029642
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=12)

Value	Count	Frequency (%)
3	9824	45.5%
4	6882	31.9%
2	2760	12.8%
5	1601	7.4%
6	272	1.3%
1	196	0.9%
7	38	0.2%
8	13	0.1%
9	6	< 0.1%
10	3	< 0.1%
Other values (2)	2	< 0.1%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1	196	0.9%
2	2760	12.8%
3	9824	45.5%
4	6882	31.9%
5	1601	7.4%
6	272	1.3%
7	38	0.2%
8	13	0.1%
9	6	< 0.1%
10	3	< 0.1%

Value	Count	Frequency (%)
33	1	< 0.1%
11	1	< 0.1%
10	3	< 0.1%
9	6	< 0.1%
8	13	0.1%
7	38	0.2%
6	272	1.3%
5	1601	7.4%
4	6882	31.9%
3	9824	45.5%

bathrooms
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	29
Distinct (%)	0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	2.115826272

Minimum	0.5
Maximum	8
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	168.9 KiB

Quantile statistics

Minimum	0.5
5-th percentile	1
Q1	1.75
median	2.25
Q3	2.5
95-th percentile	3.5
Maximum	8
Range	7.5
Interquartile range (IQR)	0.75

Descriptive statistics

Standard deviation	0.7689842967
Coefficient of variation (CV)	0.3634439683
Kurtosis	1.279315294
Mean	2.115826272
Median Absolute Deviation (MAD)	0.5
Skewness	0.5197092816
Sum	45695.5
Variance	0.5913368485
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=29)

Value	Count	Frequency (%)
2.5	5377	24.9%
1	3851	17.8%
1.75	3048	14.1%
2.25	2047	9.5%
2	1930	8.9%
1.5	1445	6.7%
2.75	1185	5.5%
3	753	3.5%
3.5	731	3.4%
3.25	589	2.7%
Other values (19)	641	3.0%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0.5	4	< 0.1%
0.75	71	0.3%
1	3851	17.8%
1.25	9	< 0.1%
1.5	1445	6.7%
1.75	3048	14.1%
2	1930	8.9%
2.25	2047	9.5%
2.5	5377	24.9%
2.75	1185	5.5%

Value	Count	Frequency (%)
8	2	< 0.1%
7.75	1	< 0.1%
7.5	1	< 0.1%
6.75	2	< 0.1%
6.5	2	< 0.1%
6.25	2	< 0.1%
6	6	< 0.1%
5.75	4	< 0.1%
5.5	10	< 0.1%
5.25	13	0.1%

sqft_living
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	1034
Distinct (%)	4.8%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	2080.32185

Minimum	370
Maximum	13540
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	168.9 KiB

Quantile statistics

Minimum	370
5-th percentile	940
Q1	1430
median	1910
Q3	2550
95-th percentile	3760
Maximum	13540
Range	13170
Interquartile range (IQR)	1120

Descriptive statistics

Standard deviation	918.1061251
Coefficient of variation (CV)	0.4413288862
Kurtosis	5.252101951
Mean	2080.32185
Median Absolute Deviation (MAD)	540
Skewness	1.473215455
Sum	44928711
Variance	842918.8569
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1300	138	0.6%
1400	135	0.6%
1440	133	0.6%
1660	129	0.6%
1800	129	0.6%
1010	129	0.6%
1820	128	0.6%
1480	125	0.6%
1720	125	0.6%
1560	124	0.6%
Other values (1024)	20302	94.0%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
370	1	< 0.1%
380	1	< 0.1%
390	1	< 0.1%
410	1	< 0.1%
420	2	< 0.1%
430	1	< 0.1%
440	1	< 0.1%
460	1	< 0.1%
470	2	< 0.1%
480	2	< 0.1%

Value	Count	Frequency (%)
13540	1	< 0.1%
12050	1	< 0.1%
10040	1	< 0.1%
9890	1	< 0.1%
9640	1	< 0.1%
9200	1	< 0.1%
8670	1	< 0.1%
8020	1	< 0.1%
8010	1	< 0.1%
8000	1	< 0.1%

sqft_lot
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	9776
Distinct (%)	45.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	15099.40876

Minimum	520
Maximum	1651359
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	168.9 KiB

Quantile statistics

Minimum	520
5-th percentile	1800.8
Q1	5040
median	7618
Q3	10685
95-th percentile	43307.2
Maximum	1651359
Range	1650839
Interquartile range (IQR)	5645

Descriptive statistics

Standard deviation	41412.63688
Coefficient of variation (CV)	2.742666122
Kurtosis	285.4958119
Mean	15099.40876
Median Absolute Deviation (MAD)	2618
Skewness	13.07260357
Sum	326101931
Variance	1715006493
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
5000	358	1.7%
6000	290	1.3%
4000	251	1.2%
7200	220	1.0%
7500	119	0.6%
4800	119	0.6%
4500	114	0.5%
8400	111	0.5%
9600	109	0.5%
3600	103	0.5%
Other values (9766)	19803	91.7%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
520	1	< 0.1%
572	1	< 0.1%
600	1	< 0.1%
609	1	< 0.1%
635	1	< 0.1%
638	1	< 0.1%
649	2	< 0.1%
651	1	< 0.1%
675	1	< 0.1%
676	1	< 0.1%

Value	Count	Frequency (%)
1651359	1	< 0.1%
1164794	1	< 0.1%
1074218	1	< 0.1%
1024068	1	< 0.1%
982998	1	< 0.1%
982278	1	< 0.1%
920423	1	< 0.1%
881654	1	< 0.1%
871200	2	< 0.1%
843309	1	< 0.1%

floors
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	6
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	1.494096402

Minimum	1
Maximum	3.5
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	168.9 KiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	1
median	1.5
Q3	2
95-th percentile	2
Maximum	3.5
Range	2.5
Interquartile range (IQR)	1

Descriptive statistics

Standard deviation	0.539682791
Coefficient of variation (CV)	0.3612101536
Kurtosis	-0.4910657592
Mean	1.494096402
Median Absolute Deviation (MAD)	0.5
Skewness	0.6144969756
Sum	32268
Variance	0.2912575149
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=6)

Value	Count	Frequency (%)
1	10673	49.4%
2	8235	38.1%
1.5	1910	8.8%
3	611	2.8%
2.5	161	0.7%
3.5	7	< 0.1%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1	10673	49.4%
1.5	1910	8.8%
2	8235	38.1%
2.5	161	0.7%
3	611	2.8%
3.5	7	< 0.1%

Value	Count	Frequency (%)
3.5	7	< 0.1%
3	611	2.8%
2.5	161	0.7%
2	8235	38.1%
1.5	1910	8.8%
1	10673	49.4%

waterfront
Categorical

HIGH CORRELATION

Distinct	2
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	168.9 KiB

0	21434
1	163

Length

Max length	1
Median length	1
Mean length	1
Min length	1

Characters and Unicode

Total characters	21597
Distinct characters	2
Distinct categories	1 ?
Distinct scripts	1 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	0
2nd row	0
3rd row	0
4th row	0
5th row	0

Common Values

Value	Count	Frequency (%)
0	21434	99.2%
1	163	0.8%

Length

Histogram of lengths of the category

Category Frequency Plot

Value	Count	Frequency (%)
0	21434	99.2%
1	163	0.8%

Most occurring characters

Value	Count	Frequency (%)
0	21434	99.2%
1	163	0.8%

Most occurring categories

Value	Count	Frequency (%)
Decimal Number	21597	100.0%

Most frequent character per category

Decimal Number

Value	Count	Frequency (%)
0	21434	99.2%
1	163	0.8%

Most occurring scripts

Value	Count	Frequency (%)
Common	21597	100.0%

Most frequent character per script

Common

Value	Count	Frequency (%)
0	21434	99.2%
1	163	0.8%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	21597	100.0%

Most frequent character per block

ASCII

Value	Count	Frequency (%)
0	21434	99.2%
1	163	0.8%

view
Categorical

HIGH CORRELATION

Distinct	5
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	168.9 KiB

0	19475
2	961
3	510
1	332
4	319

Length

Max length	1
Median length	1
Mean length	1
Min length	1

Characters and Unicode

Total characters	21597
Distinct characters	5
Distinct categories	1 ?
Distinct scripts	1 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	0
2nd row	0
3rd row	0
4th row	0
5th row	0

Common Values

Value	Count	Frequency (%)
0	19475	90.2%
2	961	4.4%
3	510	2.4%
1	332	1.5%
4	319	1.5%

Length

Histogram of lengths of the category

Category Frequency Plot

Value	Count	Frequency (%)
0	19475	90.2%
2	961	4.4%
3	510	2.4%
1	332	1.5%
4	319	1.5%

Most occurring characters

Value	Count	Frequency (%)
0	19475	90.2%
2	961	4.4%
3	510	2.4%
1	332	1.5%
4	319	1.5%

Most occurring categories

Value	Count	Frequency (%)
Decimal Number	21597	100.0%

Most frequent character per category

Decimal Number

Value	Count	Frequency (%)
0	19475	90.2%
2	961	4.4%
3	510	2.4%
1	332	1.5%
4	319	1.5%

Most occurring scripts

Value	Count	Frequency (%)
Common	21597	100.0%

Most frequent character per script

Common

Value	Count	Frequency (%)
0	19475	90.2%
2	961	4.4%
3	510	2.4%
1	332	1.5%
4	319	1.5%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	21597	100.0%

Most frequent character per block

ASCII

Value	Count	Frequency (%)
0	19475	90.2%
2	961	4.4%
3	510	2.4%
1	332	1.5%
4	319	1.5%

condition
Categorical

HIGH CORRELATION

Distinct	5
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	168.9 KiB

3	14020
4	5677
5	1701
2	170
1	29

Length

Max length	1
Median length	1
Mean length	1
Min length	1

Characters and Unicode

Total characters	21597
Distinct characters	5
Distinct categories	1 ?
Distinct scripts	1 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	5
2nd row	3
3rd row	3
4th row	3
5th row	3

Common Values

Value	Count	Frequency (%)
3	14020	64.9%
4	5677	26.3%
5	1701	7.9%
2	170	0.8%
1	29	0.1%

Length

Histogram of lengths of the category

Category Frequency Plot

Value	Count	Frequency (%)
3	14020	64.9%
4	5677	26.3%
5	1701	7.9%
2	170	0.8%
1	29	0.1%

Most occurring characters

Value	Count	Frequency (%)
3	14020	64.9%
4	5677	26.3%
5	1701	7.9%
2	170	0.8%
1	29	0.1%

Most occurring categories

Value	Count	Frequency (%)
Decimal Number	21597	100.0%

Most frequent character per category

Decimal Number

Value	Count	Frequency (%)
3	14020	64.9%
4	5677	26.3%
5	1701	7.9%
2	170	0.8%
1	29	0.1%

Most occurring scripts

Value	Count	Frequency (%)
Common	21597	100.0%

Most frequent character per script

Common

Value	Count	Frequency (%)
3	14020	64.9%
4	5677	26.3%
5	1701	7.9%
2	170	0.8%
1	29	0.1%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	21597	100.0%

Most frequent character per block

ASCII

Value	Count	Frequency (%)
3	14020	64.9%
4	5677	26.3%
5	1701	7.9%
2	170	0.8%
1	29	0.1%

grade
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	11
Distinct (%)	0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	7.657915451

Minimum	3
Maximum	13
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	168.9 KiB

Quantile statistics

Minimum	3
5-th percentile	6
Q1	7
median	7
Q3	8
95-th percentile	10
Maximum	13
Range	10
Interquartile range (IQR)	1

Descriptive statistics

Standard deviation	1.173199664
Coefficient of variation (CV)	0.1532009163
Kurtosis	1.135148022
Mean	7.657915451
Median Absolute Deviation (MAD)	1
Skewness	0.7882366364
Sum	165388
Variance	1.376397451
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=11)

Value	Count	Frequency (%)
7	8974	41.6%
8	6065	28.1%
9	2615	12.1%
6	2038	9.4%
10	1134	5.3%
11	399	1.8%
5	242	1.1%
12	89	0.4%
4	27	0.1%
13	13	0.1%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
3	1	< 0.1%
4	27	0.1%
5	242	1.1%
6	2038	9.4%
7	8974	41.6%
8	6065	28.1%
9	2615	12.1%
10	1134	5.3%
11	399	1.8%
12	89	0.4%

Value	Count	Frequency (%)
13	13	0.1%
12	89	0.4%
11	399	1.8%
10	1134	5.3%
9	2615	12.1%
8	6065	28.1%
7	8974	41.6%
6	2038	9.4%
5	242	1.1%
4	27	0.1%

sqft_above
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	942
Distinct (%)	4.4%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	1788.596842

Minimum	370
Maximum	9410
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	168.9 KiB

Quantile statistics

Minimum	370
5-th percentile	850
Q1	1190
median	1560
Q3	2210
95-th percentile	3400
Maximum	9410
Range	9040
Interquartile range (IQR)	1020

Descriptive statistics

Standard deviation	827.7597612
Coefficient of variation (CV)	0.4627984024
Kurtosis	3.405519761
Mean	1788.596842
Median Absolute Deviation (MAD)	450
Skewness	1.447434235
Sum	38628326
Variance	685186.2222
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1300	212	1.0%
1010	210	1.0%
1200	206	1.0%
1220	192	0.9%
1140	184	0.9%
1400	180	0.8%
1060	178	0.8%
1180	177	0.8%
1340	176	0.8%
1250	174	0.8%
Other values (932)	19708	91.3%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
370	1	< 0.1%
380	1	< 0.1%
390	1	< 0.1%
410	1	< 0.1%
420	2	< 0.1%
430	1	< 0.1%
440	1	< 0.1%
460	1	< 0.1%
470	2	< 0.1%
480	4	< 0.1%

Value	Count	Frequency (%)
9410	1	< 0.1%
8860	1	< 0.1%
8570	1	< 0.1%
8020	1	< 0.1%
7880	1	< 0.1%
7850	1	< 0.1%
7680	1	< 0.1%
7420	1	< 0.1%
7320	1	< 0.1%
6720	1	< 0.1%

sqft_basement
Real number (ℝ_≥0)

HIGH CORRELATION
ZEROS

Distinct	306
Distinct (%)	1.4%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	291.7250081

Minimum	0
Maximum	4820
Zeros	13110
Zeros (%)	60.7%
Negative	0
Negative (%)	0.0%
Memory size	168.9 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	560
95-th percentile	1190
Maximum	4820
Range	4820
Interquartile range (IQR)	560

Descriptive statistics

Standard deviation	442.6678004
Coefficient of variation (CV)	1.517414648
Kurtosis	2.711798303
Mean	291.7250081
Median Absolute Deviation (MAD)	0
Skewness	1.576889627
Sum	6300385
Variance	195954.7815
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	13110	60.7%
600	221	1.0%
700	218	1.0%
500	214	1.0%
800	206	1.0%
400	184	0.9%
1000	149	0.7%
900	144	0.7%
300	142	0.7%
200	108	0.5%
Other values (296)	6901	32.0%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	13110	60.7%
10	2	< 0.1%
20	1	< 0.1%
40	4	< 0.1%
50	11	0.1%
60	10	< 0.1%
65	1	< 0.1%
70	7	< 0.1%
80	20	0.1%
90	21	0.1%

Value	Count	Frequency (%)
4820	1	< 0.1%
4130	1	< 0.1%
3500	1	< 0.1%
3480	1	< 0.1%
3260	1	< 0.1%
3000	1	< 0.1%
2850	1	< 0.1%
2810	1	< 0.1%
2730	1	< 0.1%
2720	1	< 0.1%

yr_built
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	116
Distinct (%)	0.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	1970.999676

Minimum	1900
Maximum	2015
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	168.9 KiB

Quantile statistics

Minimum	1900
5-th percentile	1915
Q1	1951
median	1975
Q3	1997
95-th percentile	2011
Maximum	2015
Range	115
Interquartile range (IQR)	46

Descriptive statistics

Standard deviation	29.37523413
Coefficient of variation (CV)	0.01490372347
Kurtosis	-0.6576944258
Mean	1970.999676
Median Absolute Deviation (MAD)	23
Skewness	-0.4694499765
Sum	42567680
Variance	862.9043803
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
2014	559	2.6%
2006	453	2.1%
2005	450	2.1%
2004	433	2.0%
2003	420	1.9%
1977	417	1.9%
2007	417	1.9%
1978	387	1.8%
1968	381	1.8%
2008	367	1.7%
Other values (106)	17313	80.2%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1900	87	0.4%
1901	29	0.1%
1902	27	0.1%
1903	46	0.2%
1904	45	0.2%
1905	74	0.3%
1906	92	0.4%
1907	65	0.3%
1908	86	0.4%
1909	94	0.4%

Value	Count	Frequency (%)
2015	38	0.2%
2014	559	2.6%
2013	201	0.9%
2012	170	0.8%
2011	130	0.6%
2010	143	0.7%
2009	230	1.1%
2008	367	1.7%
2007	417	1.9%
2006	453	2.1%

yr_renovated
Real number (ℝ_≥0)

ZEROS

Distinct	70
Distinct (%)	0.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	84.46478678

Minimum	0
Maximum	2015
Zeros	20683
Zeros (%)	95.8%
Negative	0
Negative (%)	0.0%
Memory size	168.9 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	0
95-th percentile	0
Maximum	2015
Range	2015
Interquartile range (IQR)	0

Descriptive statistics

Standard deviation	401.8214379
Coefficient of variation (CV)	4.757265759
Kurtosis	18.68367598
Mean	84.46478678
Median Absolute Deviation (MAD)	0
Skewness	4.547572443
Sum	1824186
Variance	161460.468
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	20683	95.8%
2014	91	0.4%
2013	37	0.2%
2003	36	0.2%
2000	35	0.2%
2005	35	0.2%
2007	35	0.2%
2004	26	0.1%
1990	25	0.1%
2006	24	0.1%
Other values (60)	570	2.6%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	20683	95.8%
1934	1	< 0.1%
1940	2	< 0.1%
1944	1	< 0.1%
1945	3	< 0.1%
1946	2	< 0.1%
1948	1	< 0.1%
1950	2	< 0.1%
1951	1	< 0.1%
1953	3	< 0.1%

Value	Count	Frequency (%)
2015	16	0.1%
2014	91	0.4%
2013	37	0.2%
2012	11	0.1%
2011	13	0.1%
2010	18	0.1%
2009	22	0.1%
2008	18	0.1%
2007	35	0.2%
2006	24	0.1%

zipcode
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	70
Distinct (%)	0.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	98077.95185

Minimum	98001
Maximum	98199
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	168.9 KiB

Quantile statistics

Minimum	98001
5-th percentile	98004
Q1	98033
median	98065
Q3	98118
95-th percentile	98177
Maximum	98199
Range	198
Interquartile range (IQR)	85

Descriptive statistics

Standard deviation	53.51307235
Coefficient of variation (CV)	0.0005456177596
Kurtosis	-0.8540048606
Mean	98077.95185
Median Absolute Deviation (MAD)	42
Skewness	0.4053221913
Sum	2118189526
Variance	2863.648913
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
98103	602	2.8%
98038	589	2.7%
98115	583	2.7%
98052	574	2.7%
98117	553	2.6%
98042	547	2.5%
98034	545	2.5%
98118	507	2.3%
98023	499	2.3%
98006	498	2.3%
Other values (60)	16100	74.5%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
98001	361	1.7%
98002	199	0.9%
98003	280	1.3%
98004	317	1.5%
98005	168	0.8%
98006	498	2.3%
98007	141	0.7%
98008	283	1.3%
98010	100	0.5%
98011	195	0.9%

Value	Count	Frequency (%)
98199	317	1.5%
98198	280	1.3%
98188	136	0.6%
98178	262	1.2%
98177	255	1.2%
98168	269	1.2%
98166	254	1.2%
98155	446	2.1%
98148	57	0.3%
98146	288	1.3%

lat
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	5033
Distinct (%)	23.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	47.56009299

Minimum	47.1559
Maximum	47.7776
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	168.9 KiB

Quantile statistics

Minimum	47.1559
5-th percentile	47.3103
Q1	47.4711
median	47.5718
Q3	47.678
95-th percentile	47.7497
Maximum	47.7776
Range	0.6217
Interquartile range (IQR)	0.2069

Descriptive statistics

Standard deviation	0.1385517682
Coefficient of variation (CV)	0.002913193803
Kurtosis	-0.6757902106
Mean	47.56009299
Median Absolute Deviation (MAD)	0.1049
Skewness	-0.48552159
Sum	1027155.328
Variance	0.01919659246
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
47.6846	17	0.1%
47.5491	17	0.1%
47.6624	17	0.1%
47.5322	17	0.1%
47.6886	16	0.1%
47.6711	16	0.1%
47.6955	16	0.1%
47.6842	15	0.1%
47.686	15	0.1%
47.5402	15	0.1%
Other values (5023)	21436	99.3%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
47.1559	1	< 0.1%
47.1593	1	< 0.1%
47.1622	1	< 0.1%
47.1647	1	< 0.1%
47.1764	1	< 0.1%
47.1775	1	< 0.1%
47.1776	2	< 0.1%
47.1795	1	< 0.1%
47.1803	1	< 0.1%
47.1808	1	< 0.1%

Value	Count	Frequency (%)
47.7776	3	< 0.1%
47.7775	3	< 0.1%
47.7774	1	< 0.1%
47.7772	3	< 0.1%
47.7771	2	< 0.1%
47.777	2	< 0.1%
47.7769	3	< 0.1%
47.7768	2	< 0.1%
47.7767	6	< 0.1%
47.7766	4	< 0.1%

long
Real number (ℝ)

HIGH CORRELATION

Distinct	751
Distinct (%)	3.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	-122.2139825

Minimum	-122.519
Maximum	-121.315
Zeros	0
Zeros (%)	0.0%
Negative	21597
Negative (%)	100.0%
Memory size	168.9 KiB

Quantile statistics

Minimum	-122.519
5-th percentile	-122.387
Q1	-122.328
median	-122.231
Q3	-122.125
95-th percentile	-121.9798
Maximum	-121.315
Range	1.204
Interquartile range (IQR)	0.203

Descriptive statistics

Standard deviation	0.1407235288
Coefficient of variation (CV)	-0.001151451953
Kurtosis	1.052120317
Mean	-122.2139825
Median Absolute Deviation (MAD)	0.101
Skewness	0.8848883395
Sum	-2639455.38
Variance	0.01980311157
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
-122.29	115	0.5%
-122.3	111	0.5%
-122.362	104	0.5%
-122.291	100	0.5%
-122.363	99	0.5%
-122.372	99	0.5%
-122.288	98	0.5%
-122.357	96	0.4%
-122.284	95	0.4%
-122.172	94	0.4%
Other values (741)	20586	95.3%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
-122.519	1	< 0.1%
-122.515	1	< 0.1%
-122.514	1	< 0.1%
-122.512	1	< 0.1%
-122.511	2	< 0.1%
-122.509	2	< 0.1%
-122.507	1	< 0.1%
-122.506	1	< 0.1%
-122.505	3	< 0.1%
-122.504	2	< 0.1%

Value	Count	Frequency (%)
-121.315	2	< 0.1%
-121.316	1	< 0.1%
-121.319	1	< 0.1%
-121.321	1	< 0.1%
-121.325	1	< 0.1%
-121.352	2	< 0.1%
-121.359	1	< 0.1%
-121.364	2	< 0.1%
-121.402	1	< 0.1%
-121.403	1	< 0.1%

sqft_living15
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	777
Distinct (%)	3.6%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	1986.620318

Minimum	399
Maximum	6210
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	168.9 KiB

Quantile statistics

Minimum	399
5-th percentile	1140
Q1	1490
median	1840
Q3	2360
95-th percentile	3300
Maximum	6210
Range	5811
Interquartile range (IQR)	870

Descriptive statistics

Standard deviation	685.2304719
Coefficient of variation (CV)	0.3449227141
Kurtosis	1.591732789
Mean	1986.620318
Median Absolute Deviation (MAD)	410
Skewness	1.106875397
Sum	42905039
Variance	469540.7996
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1540	197	0.9%
1440	195	0.9%
1560	192	0.9%
1500	180	0.8%
1460	169	0.8%
1580	167	0.8%
1800	166	0.8%
1610	166	0.8%
1720	166	0.8%
1620	164	0.8%
Other values (767)	19835	91.8%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
399	1	< 0.1%
460	2	< 0.1%
620	2	< 0.1%
670	1	< 0.1%
690	2	< 0.1%
700	2	< 0.1%
710	2	< 0.1%
720	2	< 0.1%
740	8	< 0.1%
750	3	< 0.1%

Value	Count	Frequency (%)
6210	1	< 0.1%
6110	1	< 0.1%
5790	6	< 0.1%
5610	1	< 0.1%
5600	1	< 0.1%
5500	1	< 0.1%
5380	1	< 0.1%
5340	1	< 0.1%
5330	1	< 0.1%
5220	1	< 0.1%

sqft_lot15
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	8682
Distinct (%)	40.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	12758.28351

Minimum	651
Maximum	871200
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	168.9 KiB

Quantile statistics

Minimum	651
5-th percentile	2002.4
Q1	5100
median	7620
Q3	10083
95-th percentile	37045.2
Maximum	871200
Range	870549
Interquartile range (IQR)	4983

Descriptive statistics

Standard deviation	27274.44195
Coefficient of variation (CV)	2.137783027
Kurtosis	151.3956625
Mean	12758.28351
Median Absolute Deviation (MAD)	2505
Skewness	9.524361965
Sum	275540649
Variance	743895183.7
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
5000	427	2.0%
4000	356	1.6%
6000	288	1.3%
7200	210	1.0%
4800	145	0.7%
7500	142	0.7%
8400	116	0.5%
3600	111	0.5%
4500	111	0.5%
5100	109	0.5%
Other values (8672)	19582	90.7%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
651	1	< 0.1%
659	1	< 0.1%
660	1	< 0.1%
748	2	< 0.1%
750	4	< 0.1%
755	1	< 0.1%
757	1	< 0.1%
758	1	< 0.1%
788	1	< 0.1%
794	1	< 0.1%

Value	Count	Frequency (%)
871200	1	< 0.1%
858132	1	< 0.1%
560617	1	< 0.1%
438213	1	< 0.1%
434728	1	< 0.1%
425581	1	< 0.1%
422967	1	< 0.1%
411962	1	< 0.1%
392040	2	< 0.1%
386812	1	< 0.1%

Auto

The auto setting is an easily interpretable pairwise column metric of the following mapping: vartype-vartype : method, categorical-categorical : Cramer's V, numerical-categorical : Cramer's V (using a discretized numerical column), numerical-numerical : Spearman's ρ. This configuration uses the best suitable for each pair of columns.

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Cramér's V (φc)

Cramér's V is an association measure for nominal random variables. The coefficient ranges from 0 to 1, with 0 indicating independence and 1 indicating perfect association. The empirical estimators used for Cramér's V have been proved to be biased, even for large samples. We use a bias-corrected measure that has been proposed by Bergsma in 2013 that can be found here.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

Count
Matrix

A simple visualization of nullity by column.

Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.

First rows

	id	price	bedrooms	bathrooms	sqft_living	sqft_lot	floors	condition	grade	sqft_above	sqft_basement	yr_built	zipcode	lat	long	sqft_living15	sqft_lot15
0	9106000005	1310000.0	4	2.25	3750	5000	2.0	5	8	2440	1310	1924	98115	47.6747	-122.303	2170	4590
1	5101400871	445500.0	2	1.75	1390	6670	1.0	3	6	720	670	1941	98115	47.6914	-122.308	920	6380
2	7923600250	450000.0	5	2.00	1870	7344	1.5	3	7	1870	0	1960	98007	47.5951	-122.144	1870	7650
3	8730000270	359000.0	2	2.75	1370	1140	2.0	3	8	1080	290	2009	98133	47.7052	-122.343	1370	1090
4	9178601660	1700000.0	5	3.00	3320	5354	2.0	3	9	3320	0	2004	98103	47.6542	-122.331	2330	4040
5	1786200010	456500.0	4	2.50	2580	11780	2.0	3	9	2580	0	2003	98038	47.3658	-122.040	2410	8403
6	1422700040	183000.0	3	1.00	1170	7320	1.0	3	7	1170	0	1962	98188	47.4685	-122.282	2040	7320
7	6752600320	360000.0	4	2.50	2020	7289	2.0	3	7	2020	0	1994	98031	47.4010	-122.171	2090	7259
8	4166600610	335000.0	3	2.00	1410	44866	1.0	4	7	1410	0	1985	98023	47.3273	-122.370	2950	29152
9	7129304540	440000.0	5	2.00	1430	5600	1.5	3	6	1430	0	1947	98118	47.5192	-122.266	1860	5980

Last rows

	id	price	bedrooms	bathrooms	sqft_living	sqft_lot	floors	view	condition	grade	sqft_above	sqft_basement	yr_built	zipcode	lat	long	sqft_living15	sqft_lot15
21587	2201501015	430000.0	4	1.50	1920	10000	1.0	0	4	7	1070	850	1954	98006	47.5725	-122.133	1450	10836
21588	2423600100	491500.0	4	1.75	2190	125452	1.0	2	3	9	2190	0	1968	98092	47.2703	-122.069	3000	125017
21589	7853220390	785000.0	5	3.25	3660	11995	2.0	2	3	10	3660	0	2006	98065	47.5337	-121.860	3320	11241
21590	9267200226	436110.0	3	2.50	1770	1235	3.0	0	3	8	1600	170	2007	98103	47.6965	-122.342	1680	1203
21591	2771102144	385000.0	3	3.25	1320	1327	2.0	0	3	8	1040	280	2008	98199	47.6506	-122.383	1440	1263
21592	3438501320	295000.0	2	2.50	1630	1368	2.0	0	3	7	1280	350	2009	98106	47.5489	-122.363	1590	2306
21593	7853361370	555000.0	4	2.50	3310	6500	2.0	0	3	8	3310	0	2012	98065	47.5150	-121.870	2380	5000
21594	8564860280	459990.0	3	2.50	2680	5539	2.0	0	3	8	2680	0	2013	98045	47.4761	-121.734	2990	6037
21595	123059127	625000.0	4	3.25	2730	54014	1.0	0	3	9	1560	1170	2007	98059	47.5133	-122.110	2730	111274
21596	3832050580	300000.0	3	2.50	2540	5050	2.0	0	3	7	2540	0	2006	98042	47.3358	-122.055	2280	5050

Most frequently occurring

	id	price	bedrooms	bathrooms	sqft_living	sqft_lot	floors	view	condition	grade	sqft_above	sqft_basement	yr_built	yr_renovated	zipcode	lat	long	sqft_living15	sqft_lot15	# duplicates
0	1825069031	550000.0	4	1.75	2410	8447	2.0	3	4	8	2060	350	1936	1980	98074	47.6499	-122.088	2520	14789	2
1	6308000010	585000.0	3	2.50	2290	5089	2.0	0	3	9	2290	0	2001	0	98006	47.5443	-122.172	2290	7984	2
2	8648900110	555000.0	3	2.50	1940	3211	2.0	0	3	8	1940	0	2009	0	98027	47.5644	-122.093	1880	3078	2

Overview

Variables

Common Values

Length

Category Frequency Plot

Most occurring characters

Most occurring categories

Most frequent character per category

Decimal Number

Most occurring scripts

Most frequent character per script

Common

Most occurring blocks

Most frequent character per block

ASCII

Common Values

Length

Category Frequency Plot

Most occurring characters

Most occurring categories

Most frequent character per category

Decimal Number

Most occurring scripts

Most frequent character per script

Common

Most occurring blocks

Most frequent character per block

ASCII

Common Values

Length

Category Frequency Plot

Most occurring characters

Most occurring categories

Most frequent character per category

Decimal Number

Most occurring scripts

Most frequent character per script

Common

Most occurring blocks

Most frequent character per block

ASCII

Interactions

Correlations

Auto

Spearman's ρ

Pearson's r

Kendall's τ

Cramér's V (φc)

Phik (φk)

Missing values

Sample

First rows

Last rows

Duplicate rows

Most frequently occurring